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Abstract . Fenchel's  duality  theorem  is  extended  to  generalized  geometric 
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1.  Introduction.  Although  many  Implications  of  this  extension  have 
already  been  discussed  in  the  author's  recent  survey  paper  [1],  a proof 
of  it  is  given  here  for  the  first  time. 


This  proof  utilizes  the  unconstrained  version  that  has  already  been 
established  by  independent  and  somewhat  different  arguments  in  [2]  and 
[3].  In  doing  so,  it  exploits  the  main  result  from  [4]  and  also  requires 
some  of  the  convexity  theory  in  [3 ] --especially  the  theory  having  to  do 
with  the  "relative  interior"  (ri  S)  of  an  arbitrary  convex  set  SCE^ 
(N-dimensional  Euclidean  space). 

2.  The  unconstrained  case.  We  begin  with  the  following  notation  and 
hypotheses : 

X is  a nonempty  closed  convex  cone  in  E , 

n 

g is  a (proper)  closed  convex  function  with  a nonempty 

(effective)  domain  <2-  = E • 

n 

Now,  given  X and^,  consider  the  resulting  "geometric  programming 
problem"  £7. 


PROBLEM  <7.  Using  the  feasible  solution  set 

Axr\d, 

calculate  both  the  problem  infltnum 


cp  ■ inf  g Oc) 
XU 


and  the  optimal  solution  set 


•S*  ■ 1*  € J j g (r)  ■ cp) 


-2 


Geometric  duality  is  defined  in  terms  of  both  the  "dual  cone" 

\ ■ {y  € En  | 0 £ (x ,y)  for  each  x € X) 

and  the  "conjugate  transform  function"  h whose  (effective)  domain 

J*-{y€L|  sup  [<y,Jr> -gC*)]  is  finite} 

JC6C- 


and  whose  functional  value 


A 

My)*  sup  [{yyX)  -g(jc)]. 

x€C 

In  particular,  given  the  geometric  programming  problem^,  consider  the 
resulting  "geometric  dual  problem"  B. 

PROBLEM  0.  Using  the  feasible  solution  set 

calculate  both  the  problem  lnfimim 

t - inf  h(y) 

V ^ 


and  the  optimal  solution  set 

A 

T*m{yZT  | My) 


Fenchel's  duality  theorem  in  the  context  of  dual  problems  d and  B 
is  one  of  the  most  important  theorems  in  geometric  programing, 
be  stated  in  the  following  way. 


It  can 
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Theorem  1.  If  problem  & has  both  a feasible  solution  y°  6 (ri  y ) fl  (ri  £) 
and  a finite  infimum  $ , then 

(I)  prob lem  Ct  has  both  a nonempty  feasible  solution  set  J and  a finite 
infimum  cp»  and 


0 


(II)  problem  d has  a nonempty  optimal  solution  set  «/*. 


This  theorem  is  established  as  Theorem  31.4  on  page  335  of  [3]. 

The  implications  of  Theorem  1 are  given  on  page  26  of  [1].  An 
Important  extension  of  it  is  established  in  the  next  section. 


3.  The  constrained  case.  To  incorporate  explicit  constraints  into 
generalized  geometric  programming,  we  introduce  the  following  notation 
and  hypotheses: 


t 

■ 


I and  J are  two  nonintersecting  (possibly  empty)  positive-integer 
index  sets  with  finite  cardinality  o(I)  and  o(J)  respectively; 

x and  y are  independent  vector  variables  in  E for  k€rO)UlUJ, 

II  ** 

and  x and  y denote  the  respective  Cartesian  products  of  the  vector 

variables  x*,  i€  I,  and  y1,  i€l  while  x^  and  yJ  denote  the  respective 

Cartesian  products  of  the  vector  variables  x^,  j € J,  and  y^ , j€J;  so 

OIJ^  OljA 

the  Cartesian  products  (x  ,x  ,x  ) *x  and  (y  ,y  ,y  ) *y  are  independent 


vector  variables  in  E , where 

(1 


n0  +£  n . +£  n . ; 
I J 3 


a and  \ are  independent  vector  variables  with  respective  components 
and  for  i€I,  and  6 and  < are  independent  vector  variables  with 


respective  components  8^  and  <.  for  j 6 J; 

X and  Y are  nonempty  closed  convex  dual  cones  in  En,  and  gk  and 
are  (proper)  closed  convex  conjugate  functions  with  respective 
(effective)  domains  C^CE  and  I^ce  for  kg[0}UlUJ. 

Now,  let 


*"f(x  ,xI,a,xJ,iC)  € | (x°,xI,xJ)  € X;  a = 0;  K€Eq(j)}, 

Wiere  n + o(I)  + o(J)  «n.  In  addition,  let 

^-C(x°,xI,a.xJ,K)€En  |x°€C0;  x1€Cl,  and 

gi Cx1)  +at s o,  i 6 1 5 (xJ.k^^cJ,  j€j}, 


and  let 


where  the  (closed  convex)  function  gj  has  a domain 


'j  f (x  ,K.)  I either  K * 0 and  sup 

J dJ  € D. 


(x^.d-^)  <+«, 


ot 


< j > 0 and 


€KjCj} 


and  functional  values 


tf  Kj-O  and  sup  <x^,d^><-H» 

d €DJ  J d-J  6 Dj 

Kjgj  (x-J/Kj)  if  Kj  > 0 and  x^€KjCj. 


The  resulting  problem^ 


can  clearly  be  stated  in  the  following  way 


PROBLEM  A.  Consider  the  objective  function  G whose  domain 

C * ( (x,  K)  |xk€Ck,  k€(o)UI,  and  (xJ.iC  )€C*  j € j) 

and  whose  functional  value 

G(x, .<)  «g0(x°)^  gj(x^,iCj). 

%J 

Using  the  feasible  solution  set 

S“  ((x,K)  €C  | x 6 X,  and  g^Cx*)  s 0,  i € I}, 

calculate  both  the  problem  infimmn 

A 

Cp  * inf  G(x,K) 

(x,K)  6 S 

and  the  optimal  solution  set 

S*-C(x.O€S  | G(x,K)=tt}. 

Now,  section  3 of  [4]  shows  that 

V*  f (y°,yI.^»yJ,0)  € ErJ  (y0,yI,yJ)  € Y;  9=0,  \€Eq(i)}. 
Section  3 of  [4]  also  shows  that 

^-C(y°,yI.\,yJ,3)  €Er  |y°€D0;  (yl,\t)€D+,  i€I;yj<ED 

B j € Ev  and  hj(yJ)  +Bj  «0,  j € J} 

and  that 


My°,yX.X,yJ,0)  -hn(y°)  +Z  h1’(y1,\.), 
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t{ 


<1 


where  the  (closed  convex)  function  h*  has  a domain 


Di.  “ f (y  »*i>  I either  X^O  and  sup  (y^c1)  <4«,  or  X > 0 and  y1  e X D } 

cr  f C 1 i i 


i U 


and  functional  values 


sup  (y^c*)  if  \ -0  and  sup  (y1,c1)<-f» 
1 e r.  1 „i  c.  n 


i iv 


c1  € C 


+ 1 A 

hj[(y1,x1)  - 


Xihi(yl/Xi)  if  Xi>0  and  y1€X1Di. 


The  resulting  problem/?  can  clearly  be  stated  in  the  following  way. 


PROBLEM  B.  Consider  the  objective  function  H whose  domain 
A 


D-[(y,\)  |y  €Dk,  k € Co]  U J,  and  (yl,Xt)€D*  i€l} 
and  whose  functional  value 


H(y,X)  «h0(y°)  +2  hJCjr1,^). 


Using  the  feasible  solution  set 
A 


T-C(y.X)  6D  |y€Y,  and  hj  (yJ)  SO,  J € J), 


calculate  both  the  problem  lnflmum 


*-  inf  H(y,\) 
(y,X)  € T 


and  the  optimal  solution  set 


T*-f(y,X)  €T  | H(y,\)  «*}. 


£ 

"j 
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It  is  worth  noting  that  dual  problems  A and  B provide  the  only  com- 
pletely symmetric  duality  that  is  presently  known  for  general  (closed) 
convex  programming  with  explicit  constraints.  Moreover,  [l]  and  some  of 
the  references  cited  therein  show  that  all  other  duality  in  convex  pro- 
graming can  be  viewed  as  a special  case.  For  the  fundamental  relations 
between  geometric  duality  and  ordinary  Lagrangian  duality  see  [5] . 

Fenchel's  duality  theorem  in  the  context  of  dual  problems  A and  B 
is  one  of  the  most  important  theorems,  as  well  as  one  of  the  deepest 
theorems,  in  geometric  programming.  It  can  be  stated  in  the  following 
way. 


Theorem  2.  If 

(i)  problem  B has  a feasible  solution  (y'.X1)  such  that 

hj(y'j)<0  j € J, 

(ii)  problem  B has  a finite  infimum  ljr, 

(iii)  there  exists  a vector  (y+,\+)  such  that 

y+€  (ri  Y), 


€ (ri  Dk) 


k€  CO}  UJ, 


(riD*) 


161, 


then 


(I)  problem  A has  both  a nonempty  feasible  solution  set  S and  a 
finite  Infimum  cp,  and 


0 = cp  + t|r> 


-8- 


f 

i 


i 


: 


I , 


I 


I 


| | 
I 

I 


lJ, 


(II)  problem  A has  a nonempty  optimal  solution  set  9*. 

Proof.  We  obviously  need  only  show  that  the  Fenchel  hypothesis  in  Theorem 
1 (i.e.  the  hypothesis  that  there  exists  a vector  y°  € (ri^)  fl  (rij?))  is 
equivalent  to  hypotheses  (i)  and  (iii)  in  Theorem  2. 

Toward  that  end,  we  first  use  the  formulas  for  ^ and  3 to  derive 
comparable  formulas  for  (ri^)  and  (ri^)  --  two  derivations  that  make 
crucial  use  of  the  following  basic  facts: 

(A)  (ri  U)  = U when  U is  a vector  space, 

n r| 

(B)  (ri  V)  =x  (ri  Vfc)  when  V = x Vk  and  the  sets  Vk  are  convex, 
and 

(C)  (ri  W)  = (int  W)  , the  "interior"  of  W,  when  W is  a convex  set  with  the 
same  "dimension"  as  the  space  in  which  it  is  embedded. 


Fact  (A)  is  established  on  page  44  of  [3] ; fact  (B)  can  be  obtained  in- 
ductively from  the  formula  at  the  top  of  page  49  of  [3] ; and  fact  (C) 
is  explained  on  page  44  of  [3]. 

Now,  the  formula  for  % along  with  facts  (A)  and  (B)  implies  that 

(ri^)*  C(y°,yI,\,yJ,3)  € | (y°,yI,yJ)  € (ri  Y);  \€Eq(i);  B“0). 

Moreover,  the  formula  for  £ along  with  facts  (A)  and  (B)  implies  that 
(ri^)  - [(y°,yI,X,yJ,3)  € Er  I y°  e (ri  DQ)  ; ^>0  and  y1  € ^ (ri  D ) , 

i€  I;  y^  € (ri  Dj),  9j  6 E^  and  h^(y^)  + 9^  <0,  j € J}, 


3 


-9- 


by  virtue  of  both  the  equation 

(ri  D*)  - C (y1.  Xt>  | \ > 0 and  y1  € (ri  Dt>  ) 

and  the  equation 

(rl  { (y^ ,0 j)  | y-^  € Dj  and  hj  (y^)  +9j  so})  - 

C(y^.3j)  1 3 j € e!»  yJ  € (ri  Dj>»  and  hj  CyJ)  +3^  <o}. 

To  derive  the  latter  equation,  simply  use  Theorem  6.8  on  page  49  of  [3] 

along  with  fact  (C) . To  derive  the  former  equation,  first  consider  the 

+ + 

polnt-to-set  mapping  Y^A^  where 

Y£ -^ll  * *-yi  I € Di^ 

and 

A^-fXi  | is  not  empty}. 

Now,  Corollary  6.8.1  on  page  50  of  [3]  implies  that 

(rlD*)«  ((y1,^)  | \t€  (rl  A*)  and  y1  € (ri  Y^.J ) }. 

Moreover,  the  definition  of  D*  clearly  shows  that  A*“(X^^0},  which  means 
of  course  that 

(riA*)-  £\t>0). 

Furthermore,  for  X^>0  the  definition  of  D*  clearly  shows  that 
£ \f ] Dt.  which  means  that 

(rl  Y*txj  ) s \ (ri  Di)  for  Xi  € (rl  A*) , 


r r 

f 
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r\ 


by  virtue  of  Corollary  6.6.1  on  page  48  of  [3].  Consequently,  our 
derivation  of  the  preceding  formula  for  (ri,#)  is  complete. 

In  particular  then,  the  Fenchel  hypothesis  in  Uieorem  1 simply 
asserts  that 

there  exists  a vector  (y®,y*, X,yJ,0  ) =^° 
such  that  (y°,yI,yJ)  € (ri  Y) ; y°  € (ri  DQ) ; 

Xt>0  and  yi€X1(riDl),  i€I;  yj  6 (ri  Dj) 
and  h^  (y^)  <0,  j € J. 

To  complete  our  proof,  we  now  show  that  this  hypothesis  is  in  fact  equivalent 
to  the  hypothesis 

*0  'I  ' 'j 
there  exists  a vector  (y  ,y  , X ,y  ) 

'0  'I  * jr  '0 

such  that  (y  ,y  ,y  )€Y;  y €Dq; 

(y  i,X^)  € D*,  i € I;  y ^ € Dj  and  h^(y  <0,  j€J 
— and  there  exists  « vector 

(y*\y+I,X+,y*J)  such  that 

(y+0»y+I,y+J)  6 (ri  Y)  ; y40  € (ri  DQ) ; ' \4>  0 

and  y^S  \t(ri  D1),  i € I;  y4J  € (ri  D^)  , j€J. 

Obviously,  a vector  (y°,yI,X,yJ)  that  satisfies  the  former  hypothesis 


satisfies  both  parts  of  the  latter  hypothesis.  On  the  other  hand. 


Theorem  6.1  on  page  45  of  [3]  and  Theorem  7.1  on  page  51  of  [3]  imply  that 

• 0 * X 1 1 J 40  41  + + j 

a convex  combination  a(y  ,y  ,X  ,y  ) ♦ p(y  ,y  ,X  ,y  ) of  vectors 

• 0 * I * * j +Q  +1  + 4 j 

(y  »y  .X  ,y  ) and  (y  ,y  ,X  ,y  ) that  satisfy  the  latter  hypothesis 
will  satisfy  the  former  hypothesis  for  sufficiently  small  P>0.  q.e.d. 


• i 

Although  the  condition  h j (y  J)<0,  j€J  in  hypothesis  (i)  of  Theorem 
2 resembles  the  well-known  "Slater  constraint  qualification",  it  is  of 
course  to  be  deleted  when  J is  empty  --  which  is  the  situation  in  most 
applications.  However,  the  analogous  condition  g^(x  )<0,  i € 1 in 
hypothesis  (1)  of  the  (unstated)  dual  of  Theorem  2 (obtained  from  Theorem 
2 by  Interchanging  the  symbols  A and  B,  the  symbols  x and  y,  the  symbols 
K and  X,  the  symbols  g and  h,  the  symbols  i and  j,  the  symbols  I and  J, 
the  symbols  © and  f,  the  symbols  X and  Y,  the  symbols  C and  0,  the  symbols 
S and  T,  and  the  symbols  S*  and  T*)  is  essentially  the  Slater  constraint 
qualification.  In  fact,  we  shall  now  see  that  the  "ordinary  programming" 
case  of  the  dual  of  Theorem  2 actually  strengthens  Slater's  version  of 

the  "Kuhn- Tucker  theorem". 

The  ordinary  prograttming  case  occurs  when 


J-0. 


n.  »m  and  C » C for  some  set  C CE 
Tc  k o o m 


k € {0}UI, 


and 


X ■ column  space  of 


U 

U 


where  there  is  a total  of  l+o(I) 


Identity  matrices  U that  are  m x m 
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[ 

t ! 


[ : 


n 


In  particular,  an  explicit  elimination  of  the  vector  space  condition 
x€X  by  the  linear  transformation 


U 


shows  that  the  resulting  problem  A is  equivalent  to  the  very  general 
ordinary  programming  problem 

Minimise  gQ(z)  subject  to 
g1(s)<0  i € I 

z€  C . 
o 

Mow,  the  Slater  constraint  qualification  for  the  preceding  problem 
simply  requires  the  existence  of  a feasible  solution  s'  such  that 

1€I.  Moreover,  Slater's  version  of  the  Kuhn-Tucker  theorem 
asserts  that  the  existence  of  such  a "Slater  solution"  s'  and  the 
existence  of  a finite  infimum  q>  are  sufficient  to  guarantee  the 
existence  of  a Kuhn-Tucker  (Lagrange)  multiplier  vector  X*. 

To  strengthen  the  preceding  theorem  with  the  aid  of  the  dual  of 

Theorem  2,  first  note  that  the  image  x'  - (s', s' s')  of  a Slater 

solution  z'  under  the  given  linear  transformation  satisfies  hypothesis  (i) 
of  the  dual  of  Theorem  2.  Then,  note  that  the  existence  of  a finite 
infimum  q p is  simply  hypothesis  (ii)  of  the  dual  of  Theorem  2.  Now,  the 
convexity  of  C implies  the  existence  of  a vector  z"  € (ri  C ),  by  virtue 
of  Theorem  6.2  on  page  45  of  [3j . Moreover,  its  image  x* • (*+,*+, . . ., z+) 
under  the  given  linear  transformation  clearly  satisfies  hypothesis  (ill) 


J 


in 


13 


of  the  dual  of  Theorem  2 --  because  (ri  X)  - X by  virtue  of  fact  (A),  and 
because  J*0.  Consequently,  the  dual  of  Theorem  2 Implies  that  both  T 
and  T*  are  nonempty  and  that  0*cp  + i|r.  In  view  of  Corollary  7A  of  [6],  we 
conclude  from  the  nonemptyness  of  T*  that  a Kuhn-Tucker  (Lagrange)  vector 
Finally,  note  that  we  have  also  shown  the  existence  of 
another  vector  y*;  so  the  Slater  version  of  the  Kuhn-Tucker  theorem  has 
actually  been  strengthened. 

More  significant  implications  of  Theorem  2 are  given  on  page  47  of 

[1]. 

« 
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